Three-dimensional structured illumination microscopy with enhanced axial resolution.

The axial resolution of three-dimensional structured illumination microscopy (3D SIM) is limited to ∼300 nm. Here we present two distinct, complementary methods to improve axial resolution in 3D SIM with minimal or no modification to the optical system. We show that placing a mirror directly opposite the sample enables four-beam interference with higher spatial frequency content than 3D SIM illumination, offering near-isotropic imaging with ∼120-nm lateral and 160-nm axial resolution. We also developed a deep learning method achieving ∼120-nm isotropic resolution. This method can be combined with denoising to facilitate volumetric imaging spanning dozens of timepoints. We demonstrate the potential of these advances by imaging a variety of cellular samples, delineating the nanoscale distribution of vimentin and microtubule filaments, observing the relative positions of caveolar coat proteins and lysosomal markers and visualizing cytoskeletal dynamics within T cells in the early stages of immune synapse formation.

Incorporating the image formation process into deep learning improves network performance.

We present Richardson-Lucy network (RLN), a fast and lightweight deep learning method for three-dimensional fluorescence microscopy deconvolution. RLN combines the traditional Richardson-Lucy iteration with a fully convolutional network structure, establishing a connection to the image formation process and thereby improving network performance. Containing only roughly 16,000 parameters, RLN enables four- to 50-fold faster processing than purely data-driven networks with many more parameters. By visual and quantitative analysis, we show that RLN provides better deconvolution, better generalizability and fewer artifacts than other networks, especially along the axial dimension. RLN outperforms classic Richardson-Lucy deconvolution on volumes contaminated with severe out of focus fluorescence or noise and provides four- to sixfold faster reconstructions of large, cleared-tissue datasets than classic multi-view pipelines. We demonstrate RLN's performance on cells, tissues and embryos imaged with widefield-, light-sheet-, confocal- and super-resolution microscopy.

Nanotopography modulates cytoskeletal organization and dynamics during T cell activation.

Exposure to MHC-antigen complexes on the surface of antigen-presenting cells (APCs) activates T cells, inducing the formation of the immune synapse (IS). Antigen detection at the APC surface is thus a critical step in the adaptive immune response. The physical properties of antigen-presenting surfaces encountered by T cells in vivo are believed to modulate T cell activation and proliferation. Although stiffness and ligand mobility influence IS formation, the effect of the complex topography of the APC surface on this process is not well understood. Here we investigate how nanotopography modulates cytoskeletal dynamics and signaling during the early stages of T cell activation using high-resolution fluorescence microscopy on nanofabricated surfaces with parallel nanoridges of different spacings. We find that although nanoridges reduce the maximum spread area as compared with cells on flat surfaces, the ridges enhance the accumulation of actin and the signaling kinase ZAP-70 at the IS. Actin polymerization is more dynamic in the presence of ridges, which influence the directionality of both actin flows and microtubule (MT) growth. Our results demonstrate that the topography of the activating surface exerts both global effects on T cell morphology and local changes in actin and MT dynamics, collectively influencing T cell signaling.

Cytotoxic T Lymphocyte Activation Signals Modulate Cytoskeletal Dynamics and Mechanical Force Generation.

Cytotoxic T lymphocytes (CTLs) play an integral role in the adaptive immune response by killing infected cells. Antigen presenting cells (APCs), such as dendritic cells, present pathogenic peptides to the T cell receptor on the CTL surface and co-stimulatory signals required for complete activation. Activated CTLs secrete lytic granules containing enzymes that trigger target cell death at the CTL-target contact, also known as the immune synapse (IS). The actin and microtubule cytoskeletons are instrumental in the killing of CTL targets. Lytic granules are transported along microtubules to the IS, where granule secretion is facilitated by actin depletion and recovery. Furthermore, actomyosin contractility promotes target cell death by mediating mechanical force exertion at the IS. Recent studies have shown that inflammatory cytokines produced by APCs, such as interleukin-12 (IL-12), act as a third signal for CTL activation and enhance CTL proliferation and effector function. However, the biophysical mechanisms mediating such enhanced effector function remain unclear. We hypothesized that the third signal for CTL activation, IL-12, modulates cytoskeletal dynamics and force exertion at the IS, thus potentiating CTL effector function. Here, we used live cell total internal reflection fluorescence (TIRF) microscopy to study actomyosin and microtubule dynamics at the IS of murine primary CTLs activated in the presence of peptide-MHC and co-stimulation alone (two signals), or additionally with IL-12 (three signals). We found that three signal-activated CTLs have altered actin flows, myosin dynamics and microtubule growth rates as compared to two signal-activated CTLs. We further showed that lytic granules in three-signal activated CTLs are less clustered and have lower velocities than in two-signal activated CTLs. Finally, we used traction force microscopy to show that three signal-activated CTLs exert greater traction forces than two signal-activated CTLs. Our results demonstrate that activation of CTLs in the presence of IL-12 leads to differential modulation of the cytoskeleton, thereby augmenting the mechanical response of CTLs to their targets. This indicates a potential physical mechanism via which the third signal can enhance the CTL response.

Bidirectional feedback between BCR signaling and actin cytoskeletal dynamics.

When B cells are exposed to antigens, they use their B-cell receptors (BCRs) to transduce this external signal into internal signaling cascades and uptake antigen, which activate transcriptional programs. Signaling activation requires complex cytoskeletal remodeling initiated by BCR signaling. The actin cytoskeletal remodeling drives B-cell morphological changes, such as spreading, protrusion, contraction, and endocytosis of antigen by mechanical forces, which in turn affect BCR signaling. Therefore, the relationship between the actin cytoskeleton and BCR signaling is a two-way feedback loop. These morphological changes represent the indirect ways by which the actin cytoskeleton regulates BCR signaling. Recent studies using high spatiotemporal resolution microscopy techniques have revealed that actin also can directly influence BCR signaling. Cortical actin networks directly affect BCR mobility, not only during the resting stage by serving as diffusion barriers, but also at the activation stage by altering BCR diffusivity through enhanced actin flow velocities. Furthermore, the actin cytoskeleton, along with myosin, enables B cells to sense the physical properties of its environment and generate and transmit forces through the BCR. Consequently, the actin cytoskeleton modulates the signaling threshold of BCR to antigenic stimulation. This review discusses the latest research on the relationship between BCR signaling and actin remodeling, and the research techniques. Exploration of the role of actin in BCR signaling will expand fundamental understanding of the relationship between cell signaling and the cytoskeleton and the mechanisms underlying cytoskeleton-related immune disorders and cancer.

Multiview confocal super-resolution microscopy.

Confocal microscopy1 remains a major workhorse in biomedical optical microscopy owing to its reliability and flexibility in imaging various samples, but suffers from substantial point spread function anisotropy, diffraction-limited resolution, depth-dependent degradation in scattering samples and volumetric bleaching2. Here we address these problems, enhancing confocal microscopy performance from the sub-micrometre to millimetre spatial scale and the millisecond to hour temporal scale, improving both lateral and axial resolution more than twofold while simultaneously reducing phototoxicity. We achieve these gains using an integrated, four-pronged approach: (1) developing compact line scanners that enable sensitive, rapid, diffraction-limited imaging over large areas; (2) combining line-scanning with multiview imaging, developing reconstruction algorithms that improve resolution isotropy and recover signal otherwise lost to scattering; (3) adapting techniques from structured illumination microscopy, achieving super-resolution imaging in densely labelled, thick samples; (4) synergizing deep learning with these advances, further improving imaging speed, resolution and duration. We demonstrate these capabilities on more than 20 distinct fixed and live samples, including protein distributions in single cells; nuclei and developing neurons in Caenorhabditis elegans embryos, larvae and adults; myoblasts in imaginal disks of Drosophila wings; and mouse renal, oesophageal, cardiac and brain tissues.

Three-dimensional residual channel attention networks denoise and sharpen fluorescence microscopy image volumes.

We demonstrate residual channel attention networks (RCAN) for the restoration and enhancement of volumetric time-lapse (four-dimensional) fluorescence microscopy data. First we modify RCAN to handle image volumes, showing that our network enables denoising competitive with three other state-of-the-art neural networks. We use RCAN to restore noisy four-dimensional super-resolution data, enabling image capture of over tens of thousands of images (thousands of volumes) without apparent photobleaching. Second, using simulations we show that RCAN enables resolution enhancement equivalent to, or better than, other networks. Third, we exploit RCAN for denoising and resolution improvement in confocal microscopy, enabling ~2.5-fold lateral resolution enhancement using stimulated emission depletion microscopy ground truth. Fourth, we develop methods to improve spatial resolution in structured illumination microscopy using expansion microscopy data as ground truth, achieving improvements of ~1.9-fold laterally and ~3.6-fold axially. Finally, we characterize the limits of denoising and resolution enhancement, suggesting practical benchmarks for evaluation and further enhancement of network performance.

Actomyosin dynamics modulate microtubule deformation and growth during T-cell activation.

Activation of T-cells leads to the formation of immune synapses (ISs) with antigen-presenting cells. This requires T-cell polarization and coordination between the actomyosin and microtubule cytoskeletons. The interactions between these two cytoskeletal components during T-cell activation are not well understood. Here, we elucidate the interactions between microtubules and actin at the IS with high-resolution fluorescence microscopy. We show that microtubule growth dynamics in the peripheral actin-rich region is distinct from that in the central actin-free region. We further demonstrate that these differences arise from differential involvement of Arp2/3- and formin-nucleated actin structures. Formin inhibition results in a moderate decrease in microtubule growth rates, which is amplified in the presence of integrin engagement. In contrast, Arp2/3 inhibition leads to an increase in microtubule growth rates. We find that microtubule filaments are more deformed and exhibit greater shape fluctuations in the periphery of the IS than at the center. Using small molecule inhibitors, we show that actin dynamics and actomyosin contractility play key roles in defining microtubule deformations and shape fluctuations. Our results indicate a mechanical coupling between the actomyosin and microtubule systems during T-cell activation, whereby different actin structures influence microtubule dynamics in distinct ways.

Rapid image deconvolution and multiview fusion for optical microscopy.

The contrast and resolution of images obtained with optical microscopes can be improved by deconvolution and computational fusion of multiple views of the same sample, but these methods are computationally expensive for large datasets. Here we describe theoretical and practical advances in algorithm and software design that result in image processing times that are tenfold to several thousand fold faster than with previous methods. First, we show that an 'unmatched back projector' accelerates deconvolution relative to the classic Richardson-Lucy algorithm by at least tenfold. Second, three-dimensional image-based registration with a graphics processing unit enhances processing speed 10- to 100-fold over CPU processing. Third, deep learning can provide further acceleration, particularly for deconvolution with spatially varying point spread functions. We illustrate our methods from the subcellular to millimeter spatial scale on diverse samples, including single cells, embryos and cleared tissue. Finally, we show performance enhancement on recently developed microscopes that have improved spatial resolution, including dual-view cleared-tissue light-sheet microscopes and reflective lattice light-sheet microscopes.

WASP family proteins regulate the mobility of the B cell receptor during signaling activation.

Regulation of membrane receptor mobility tunes cellular response to external signals, such as in binding of B cell receptors (BCR) to antigen, which initiates signaling. However, whether BCR signaling is regulated by BCR mobility, and what factors mediate this regulation, are not well understood. Here we use single molecule imaging to examine BCR movement during signaling activation and a novel machine learning method to classify BCR trajectories into distinct diffusive states. Inhibition of actin dynamics downstream of the actin nucleating factors, Arp2/3 and formin, decreases BCR mobility. Constitutive loss or acute inhibition of the Arp2/3 regulator, N-WASP, which is associated with enhanced signaling, increases the proportion of BCR trajectories with lower diffusivity. Furthermore, loss of N-WASP reduces the diffusivity of CD19, a stimulatory co-receptor, but not that of FcγRIIB, an inhibitory co-receptor. Our results implicate a dynamic actin network in fine-tuning receptor mobility and receptor-ligand interactions for modulating B cell signaling.

Single-shot super-resolution total internal reflection fluorescence microscopy.

We combined instant structured illumination microscopy (iSIM) with total internal reflection fluorescence microscopy (TIRFM) in an approach referred to as instant TIRF-SIM, thereby improving the lateral spatial resolution of TIRFM to 115 ± 13 nm without compromising speed, and enabling imaging frame rates up to 100 Hz over hundreds of time points. We applied instant TIRF-SIM to multiple live samples and achieved rapid, high-contrast super-resolution imaging close to the coverslip surface.

Reflective imaging improves spatiotemporal resolution and collection efficiency in light sheet microscopy.

Light-sheet fluorescence microscopy (LSFM) enables high-speed, high-resolution, and gentle imaging of live specimens over extended periods. Here we describe a technique that improves the spatiotemporal resolution and collection efficiency of LSFM without modifying the underlying microscope. By imaging samples on reflective coverslips, we enable simultaneous collection of four complementary views in 250 ms, doubling speed and improving information content relative to symmetric dual-view LSFM. We also report a modified deconvolution algorithm that removes associated epifluorescence contamination and fuses all views for resolution recovery. Furthermore, we enhance spatial resolution (to <300 nm in all three dimensions) by applying our method to single-view LSFM, permitting simultaneous acquisition of two high-resolution views otherwise difficult to obtain due to steric constraints at high numerical aperture. We demonstrate the broad applicability of our method in a variety of samples, studying mitochondrial, membrane, Golgi, and microtubule dynamics in cells and calcium activity in nematode embryos.

Simultaneous multiview capture and fusion improves spatial resolution in wide-field and light-sheet microscopy.

Most fluorescence microscopes are inefficient, collecting only a small fraction of the emitted light at any instant. Besides wasting valuable signal, this inefficiency also reduces spatial resolution and causes imaging volumes to exhibit significant resolution anisotropy. We describe microscopic and computational techniques that address these problems by simultaneously capturing and subsequently fusing and deconvolving multiple specimen views. Unlike previous methods that serially capture multiple views, our approach improves spatial resolution without introducing any additional illumination dose or compromising temporal resolution relative to conventional imaging. When applying our methods to single-view wide-field or dual-view light-sheet microscopy, we achieve a twofold improvement in volumetric resolution (~235 nm × 235 nm × 340 nm) as demonstrated on a variety of samples including microtubules in Toxoplasma gondii, SpoVM in sporulating Bacillus subtilis, and multiple protein distributions and organelles in eukaryotic cells. In every case, spatial resolution is improved with no drawback by harnessing previously unused fluorescence.

Slow sedimentation and deformability of charged lipid vesicles.

The study of vesicles in suspension is important to understand the complicated dynamics exhibited by cells in in vivo and in vitro. We developed a computer simulation based on the boundary-integral method to model the three dimensional gravity-driven sedimentation of charged vesicles towards a flat surface. The membrane mechanical behavior was modeled using the Helfrich Hamiltonian and near incompressibility of the membrane was enforced via a model which accounts for the thermal fluctuations of the membrane. The simulations were verified and compared to experimental data obtained using suspended vesicles labelled with a fluorescent probe, which allows visualization using fluorescence microscopy and confers the membrane with a negative surface charge. The electrostatic interaction between the vesicle and the surface was modeled using the linear Derjaguin approximation for a low ionic concentration solution. The sedimentation rate as a function of the distance of the vesicle to the surface was determined both experimentally and from the computer simulations. The gap between the vesicle and the surface, as well as the shape of the vesicle at equilibrium were also studied. It was determined that inclusion of the electrostatic interaction is fundamental to accurately predict the sedimentation rate as the vesicle approaches the surface and the size of the gap at equilibrium, we also observed that the presence of charge in the membrane increases its rigidity.